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Abstract 

In this paper we study the problem of improving human hand pose sensing 
device performance by exploiting the knowledge on how humans most frequently 
use their hands in grasping tasks. In a companion paper we studied the problem 
of maximizing the reconstruction accuracy of the hand pose from partial and noisy 
data provided by any given pose sensing device (a sensorized "glove") taking into 
account statistical a priori information. In this paper we consider the dual problem 
of how to design pose sensing devices, i.e. how and where to place sensors on a 
glove, to get maximum information about the actual hand posture. We study the 
continuous case, whereas individual sensing elements in the glove measure a linear 
combination of joint angles, the discrete case, whereas each measure corresponds 
to a single joint angle, and the most general hybrid case, whereas both continu- 
ous and discrete sensing elements are available. The objective is to provide, for 
given a priori information and fixed number of measurements, the optimal design 
minimizing in average the reconstruction error. Solutions relying on the geomet- 
rical synergy definition as well as gradient flow-based techniques are provided. 
Simulations of reconstruction performance show the effectiveness of the proposed 
optimal design. 

1 Introduction 

This paper investigates the problem of estimating the posture of human hands us- 
ing sensing devices, and how to improve their performance based on the knowledge 
on how humans most frequently use their hands. Similarly to the companion paper 
[Bianchi eTa l., 2012b |, this work is motivated by studies on the human hand in grasp- 
ing tasks |San tello et al., 199 8 1 suggesting hand posture representations of increasing 
complexity ("synergies"), which allow to reduce the number of Degrees of Freedom 
(DoFs) to be used according to the desired level of approximation. In |Bian chi et al., 2 012b |, 
we analyzed the role of the a priori information for pose hand reconstructions by us- 
ing given sensing devices, and showed that acceptable reconstruction results can be 
obtained even in presence of insufficient and inaccurate sensing data. 
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Figure 1: Examples of continuous and discrete sensorized gloves. On the left, a sensing 
glove based on conductive elastomer sensor strips printed on fabric, each measuring a 



linear combination of joint angles |Tognetti et al., 2006 1 . On the right, the Humanglove 



(image courtesy by Humanware s.r.l. (www.hmw.it/)), using individual joint angle sen- 
sors. 



In this work, we extend the analysis to consider the optimal design of sensing 
"gloves", i.e. devices for hand pose reconstruction based on measurements of few ge- 
ometric features of the hand. The problem we consider is to find the distribution of a 
number of sensing elements of limited accuracy so as to provide, together with the a 
priori information, the optimal design which minimizes in probability the reconstruc- 
tion error. The problem becomes particularly relevant when limits on the production 
costs of sensing gloves introduce constraints limiting both the number and the quality 
of sensors. In these cases, a careful design of sensor distribution is instrumental to 
obtain good performance. 

Optimal experimental design represents a challenging, widely discussed topic in 
literature [Pukelshei m, 2006) . Among all optimal design criteria, Bayesian methods 
are ideally suited to contribute to experimental design and error statistics minimization, 
when some information is available prior to experimentation (see e.g. [Chal oner and V erdinelli , 1995| 
|Ghosh and Rao, 1996[ Bicchi and Canepa, 1994 1 for a review). On the contrary, non 
Bayesian criteria are adopted when a linear Gaussian hypothesis is not fulfilled and/or 
when the designer's primary concern is to minimize worst-case sensing errors rather 
than error statistics. Criteria on explicit worst-case/deterministic bounds on the errors 
and tools from the theory of optimal worst-case/deterministic estimation and/or identi- 
fication are discussed e.g. in [HelmickTetaLTTWl] Tempo, 1988 Bicchi and Canepa, 1994 
IBicchi, 1992) . 

However, most of these approaches refer to cases with a number of basic sensors 
which is redundant or at least equal to the number of variables to be estimated. More- 
over, no previous example of application to the peculiar problem of exploiting the a pri- 
ori psychophysical information on the structure of human hand embodiment for under- 
sensorized gloves has ever been reported. In [Stur man and Zeltzer, 199 3 1 an investiga- 
tion of "whole-hand" interfaces for the control of complex tasks is presented, along 
with the description, design, and evaluation of whole-hand inputs, based on empirical 
data from users. In [Edmis on et al., 2002[ authors discussed the properties, advantages, 
and design aspects associated with piezoelectric materials for sensing glove design, in 



an application where the device is used as a keyboard. Finally, | Chang et al. , 2007) 
authors explored how to methodically select a minimal set of hand pose features from 
optical marker data for grasp recognition. The objective is to determine marker loca- 
tions on the hand surface that is appropriate for grasp classification of hand poses. All 
the aforementioned approaches rely on experimental or qualitative observations: from 
actual sensor data, locations that provide the largest and most useful information on the 
system are chosen. 

In this paper, we investigate in depth the problem of obtaining the optimal distri- 
bution of sensors minimizing in probability the reconstruction error of hand poses. We 
adopt a classical Bayesian approach to minimize the a posteriori covariance matrix 
norm and hence, to maximize the information on the real hand posture available by the 
glove measurement. 

The a posteriori covariance matrix, P p — P — P t ,H T (HP a H T +R)~ l HP a , which di- 
rectly depends on the sensor design through the measurement matrix H, its noise co- 
variance R, and on the a priori information P , represents a measure of the amount of 
information that the observable variables carry about the unknown pose parameters. 
Here we explore the role of the measurement matrix H on the estimation procedure, 
providing the optimal design of a sensing device able to get the maximum amount of 
the information on the actual hand posture. 

We first consider the continuous sensing case, where individual sensing elements 
in the glove can be designed so as to measure a linear combination of joint angles. An 
example of this type is the sensorized glove developed in | Tognetti et al., 2006 1 (cf. fig- 
ure [Tfa)l >, or the 5DT Data Glove (5DT Inc., Irvine, CA - USA). Other devices, such 
as e.g. the Cyberglove (CyberGlove System LLC, San Jose, CA - USA), or the Hu- 
manglove (Humanware s.r.l., Pisa, Italy) shown in figure 1(b) provide instead discrete 
sensing, i.e. each sensor provides a measure of a single joint angle. 

Finally, for the sake of generality, we consider the optimal design of hybrid sensing 
devices, which combine continuous and discrete sensors. It is interesting to note that 
human hands represent, to some extent, examples of such hybrid sensing: among the 
cutaneous mechanoreceptors in the dorsal skin of the hand that were demonstrated to 
be involved in the responses to finger movements, [Edin and Abb s, 1991| includes both 
Fast Adapting (mainly FAI) afferents, with localized response to movements about one 
or, at most, two nearby joints; and Slow Adapting (SA) afferents, whose discharge rate 
is influenced by several joints interactively. Note also that FA units are found primarily 
close to joints, while SA units are more uniformly distributed. 

To validate our technique we consider hand posture reconstruction using a lim- 
ited number of measurements from a set of grasp postures acquired with an opti- 
cal tracking system, providing accurate reference poses. Experiments and statisti- 
cal analyses demonstrate the improvement of the estimation techniques proposed in 
[Bian chi et al., 2012b | by using the optimal design proposed in this paper. 



2 Problem Definition 



For reader's convenience we summarize here the definitions and results of | Bian chi et al., 2012bl 
used in the following. Let us assume a n degrees of freedom kinematic hand model and 



let 3; € R m be the measures provided by a sensing glove. The relationship between joint 
variables x € R" and measurements y is 

y = Hx + v, (1) 

where H £ ]R™ xn ( m < n ) is a full row rank matrix, and v € R™ is a vector of measure- 
ment noise. In [Bian chi et al., 2 012b | , the goal is to determine the hand posture, i.e. the 
joint angles x, by using a set of measures y whose number is lower than the number 
of DoFs describing the kinematic hand model in use. To improve the hand pose re- 
construction, we used postural synergy information embedded in the a priori grasp set, 
which is obtained by collecting a large number N of grasp postures x,, consisting of n 
DoFs, into a matrix X g R" xA \ This information can be summarized in a covariance 
matrix f„ e R" x ", which is a symmetric matrix computed as P a — ^ X ~ x ^^ , where x 
is a matrix nxN whose columns contain the mean values for each joint angle arranged 
in vector jU € R". 

Based on the Minimum Variance Estimation (MVE) technique, in [Bianchi et al., 20 12b] 
we obtained the hand pose reconstruction as 

x = (P- 1 +H T R- l H)- 1 (H T R- l y + p- l Ho) , (2) 

where matrix P p = (P~ l + H T R~ l H)~ l is the a posteriori covariance matrix. When 
R tends to assume very small values, the solution described in (|2]i might encounter 
numerical problems. However, by using the Sherman-Morrison- Woodbury formulae, 
|2} can be rewritten as 

x = \i a - P H T {HP () H T +R)- 1 (Hn„ - y) , (3) 

and the a posteriori covariance matrix becomes P p = P u — P„H J (HP a H T +R)~ 1 HP a . 

The a posteriori covariance matrix, which depends on measurement matrix H, rep- 
resents a measure of the amount of information that an observable variable carries about 
unknown parameters. In this paper we will explore the role of the measurement matrix 
H on the estimation procedure, providing the optimal design of a sensing device able 
to obtain the maximum amount of the information on the actual hand posture. 

Let us preliminary introduce some useful notations. If M is a symmetric matrix with 
dimension n, let its Singular Value Decomposition (S VD) be M = Um^mU^, where T,m 
is the diagonal matrix containing the singular values ffi (M) > 02 (M) > ■ ■ ■ > O n (M) 
of M and Um is an orthogonal matrix whose columns m, (M) are the eigenvectors of M, 
known as Principal Components (PCs) of M, associated with C7, (M). For example, the 
SVD of the a priori covariance matrix is P = Up T.p o Up o , with <7, (P„) and m,(P ), i = 
1,2,..., n, the singular values and the principal components of matrix P a , respectively. 

3 Optimal Sensing Design 

We first analyze the case that individual sensing elements in the glove can be designed 
to measure a linear combination of joint angles (continuous sensing devices), and pro- 
vide, for given a priori information and fixed number of measurements, the optimal 



design, minimizing in average the reconstruction error. We then consider the case 
where each measure provided by the glove corresponds to a single joint angle (discrete 
sensing devices). For these types of gloves we determine which joint should be individ- 
ually measured in order to optimize the design. Finally, we will consider the case that 
both continuous and discrete sensor elements are used in the achieve sensing devices, 
defining a procedure to obtain the optimal hybrid sensing glove design. 

In the ideal case of noiseless measures (R — 0), P p becomes zero when H is a 
full rank n matrix, meaning that available measures contain a complete information 
about the hand posture. In the real case of noisy measures and/or when the number 
of measurements m is less than the number of DoFs n, P„ can not be zero. In these 
cases, the following problem becomes very interesting: find the optimal matrix H* 
such that the hand posture information contained in the fewer number of measurements 
is maximized. Without loss of generality, we assume H to be full row rank and we 
consider the following problem. 

Problem 1. Let H be an m x n full row rank matrix with m < n and Vi(P 0l H ,R) : 
R mx " — > R be defined as V\ (P ,H,R) = \\P - P () H T {HP H T +R)- l HP a \\ 2 F , find 

H* = argminVi (P ,H,R) 

H 

where \\ ■ \\p denotes the Frobenius norm defined as \\A\\p = y/\x{AA T ),forA G R' ,x ". 

To solve problem [T] means to minimize the entries of the a posteriori covariance 
matrix: the smaller the values of the elements in P p , the greater is the predictive effi- 
ciency. 

In order to simplify the analysis, in the following we will analyze separately the 
design of continuous, discrete and hybrid sensing devices. 

3.1 Continuous Sensing Design 

For this case, each row of the measurement matrix H is a vector in R" and hence can 
be given as a linear combination of a R" basis. Without loss of generality, we can 
use the principal components of matrix P„, i.e. the columns of the previously defined 
matrix Up B , as a basis of R". Consequently the measurement matrix can be written 
as H = H e Up o , where H e 6 ]R mx " contains the coefficients of the linear combinations. 
Given that P = Up T.p o Up o , the a posteriori covariance matrix becomes 

P p = U Po [Z - Z Hj{H e L H? +R)- l H e Z ( ] U T Po , (4) 

where, for simplicity of notation E„ = Y,p o . 

Next sections are dedicated to describe the optimal continuous sensing design both 
in a numerical and analytical way. For this purpose, let us introduce the set of m x n 
(with m < n) matrices with orthogonal rows, i.e. satisfying the condition HH T = I mxm , 
and let us denote it as & mxn . 



3.1.1 Analytical Solutions 



We first consider the case of noiseless measures, i.e. R = 0. Let A be a non-negative 
matrix of order n. It is well known (cf. [R ao, 196*41 ) that, for any given matrix B of 
rank m with m < n, 

mm\\A-B\\ 2 F = a* +1 +--- + CC?;, (5) 

D 

where a, are the eigenvalues of A, and the minimum is attained when 

B = ct\w\w\ T H Va m w m w m T , (6) 

where w, are the eigenvector of A associated with a,-. In other words, the choice of B 
as in (|6]l is the best fitting matrix of given rank m to A. By using this result we are able 
to show when the minimum of fill, hence of 

||£ — Z-oHJ (HJLoHj ) 1 H e l. 1 1 \ , (7) 

can be reached. Let us preliminary observe that the row vectors (hj) e of H e can be 
chosen, without loss of generality, to satisfy the condition (hi) e 'L (hj) e = 0, i ^ j, 
which implies that the measures are uncorrelated (|Ra o, 19641 ). Let & my ,n denotes the 
set of m x n matrices, with m < n, whose rows satisfy the aforementioned condition, 
i.e. the set of matrices with orthonormal rows (H e Hj = I). By using ([5), the minimum 
of |7| is obtained when (cf. |Rao, 19641 ) 

zX(W r ) -1 ^ = Po)m + • • • + 

j (8) 
+ cr m (£„ ) u m (E )u m (£ ) . 

Since E„ is a diagonal matrix, m,(E ) = e,-, where e, is the i-th element of the canon- 
ical basis. Hence, it is easy to verify that |8]i holds for H e = [I m 1 mx («-«)]. As 
a consequence, row vectors (/z,-) of Z/ are the first m principal components of P , 
i.e. (hi) = Ui(P ) T , for / = l,...,m. 

From these results, a principal component can be defined as a linear combination of 
optimally-weighted observed variables meaning that the corresponding measures can 
account for a maximal amount of variance in the data set. As reported in |Rao, 1964|, 
every set of m optimal measures can be considered as a representation of points in 
the best fitting lower dimensional subspace. Thus the first measure gives the best 
one-dimensional representation of data set, the first two measures give the best two- 
dimensional representation, and so on. 

In the noisy measurement case, (|8]l can be rewritten as 

L Hj(H e L Hj +R)- l H e L a - a x (Z ) M] (£,>[(£„) + ■ ■ ■ + 

+ a m (E ) u m (£ ) u T m (E„ ) = A 

In this case, A = can not be attained for any finite H: indeed, for unconstrained 
H, inf ft V\ (Po, H ,R) would be attained for \\H\\ — > °°, i.e. for infinite signal-to-noise 
ratio. The problem can be recast in a well-posed form by imposing a constraint on 
the magnitude of the measurement matrix. Up to a possible renormalization of R, we 



can search the optimum design in the set srf = {H : HH T = /„,}. This problem was 
discussed and solved in [Diamanta ras and Ho rnik, 1993 1, showing that, for arbitrary 
noise covariance matrix R, 



miny 1 (H) = ^— — ^ — + £ a,(P ), (9) 



which is attained for 

m 

H = Y,u m - i+ i{R)ui{P ). (10) 

i=l 

Hence, if srf consists of all matrices with mutually perpendicular, unit length rows, 
the first m principal components of P a are still the optimal choice for H rows. The 
alternative case that the solution is sought under a Frobenius norm constraint on H, 
i.e. &/ = {H : \\H\\f < 1} is discussed in [Diamantara s and Hornik, 1993| . 



3.1.2 Numerical Solution: Gradient flows on mxn 

In this subsection we describe a different approach to the solution of problem[T] which 
consists of constructing a differential equation whose trajectories converge to the de- 
sired optimum. The method lends itself directly to efficient numerical implementations. 
Although a closed-form solution has been proposed in the previous subsection, the nu- 
merical solution considered here is very useful when constraints are imposed on the 
measurement structure (as they will be for instance in the hybrid sensor design), where 
closed form solutions are not applicable. 

The following proposition describes an algorithm that minimizes the cost function 
V\ (P r) ,H,R), providing the gradient flow which will be useful in the method of steepest 
descent. 

Proposition 1. The gradient flow for the function Vi(P,,,H,R) : R mx " — > ]R is given by, 

h = -nppWl = 4 [p 2 p p H T m)\ T . (id 

where L(H) = (HP H T +R)~\ 

Proof. See Appendix. □ 

Let us observe that rows of matrix H can be chosen, without loss of generality, 
such that HjP () Hj =0, i ^ j which imply that measures are uncorrelated, i.e. satisfying 
the condition HH T = l m . Of course, in case of noise-free sensors, this constraint is 
not strictly necessary. On the other hand, in case of noisy sensors, the minimum of 
Vi(P () ,H ,R) can not be obtained since it represents a limit case that can be achieved 
when H becomes very large (i.e. an infimum) and hence increasing the signal-to-noise 
ratio. 

A reasonable solution for the constrained problem will be provided by using the 
Rosen's gradient projection method for linear constraints | Rosen, 1960 1, which is based 
on projecting the search direction into the subspace tangent to the constraint. Hence, 
given the steepest descent direction for the unconstrained problem, this method consists 



on finding the direction with the most negative directional derivative which satisfies the 
constraint on the structure of the matrix H, i.e. HH T = I m . This can be obtained by 
using the projection matrix 

W=I m -H{H T H)- l H T , (12) 

and then projecting the unconstrained gradient flow ( fTTj ) into the subspace tangent to 
the constraint, obtaining the search direction 

s = WV\\P p \\ 2 P . (13) 

Having the search direction for the constrained problem, the gradient flow is given 

by 

H=-4W [P^P H T Y.(H)] T (14) 

where £(//) = (HP U H T +R)~ 1 . The gradient flow ( fTTfr guarantees that the optimal 
solution H* will satisfy H*(H*) T = /„„ if H(0) satisfies H(0)H(0) T = I m , i.e. H G 

(?m x n ■ 

Notice that both ff mxn and V\ (P ,H,R) are not convex, hence the problem could not 
have a unique minimum. However, in case of noise-free measures, the invariance of 
the cost function w.r.t. changes of basis, i.e. Vi(P o ,H,0) = V\(P o ,MH,0) withM g R m 
a full rank matrix, suggests that there exists a subspace in R" where the optimum 
is achieved. Indeed, gradients become zero when rows of matrix H are any linear 
combination of a subset of m principal components of the a priori covariance matrix. 
Unfortunately, this does not happen in case of noisy measures and gradients become 
zero only for a particular matrix H which depends also on the principal components of 
the noise covariance matrix. 



3.2 Discrete Sensing Design 

When each measure y ,-, j = l,...,m provided by the glove corresponds to a single joint 
angle x,, i = 1, . . . ,n, the problem is to find the optimal choice of m joints or DoFs to 
be measured. 

Measurement matrix becomes in this case a full row rank matrix where each row is 
a vector of the canonical basis, i.e. matrices which have exactly one nonzero entry in 
each row. 

Let JVmxn denote the set of mxn element-wise non-negative matrices, then £P mxn = 
&mxn H ^mxm where 3^mxn is the set of mxn permutation matrices (see lemma 2.5 in 
[Zavlanos and Pa ppas, 2008 1). This result implies that if we restrict H to be orthonor- 
mal and element-wise non-negative, we get a permutation matrix. In this paper we 
extend this result in R™ xn , obtaining matrices which have exactly one nonzero entry in 
each row. Hence, the problem to solve becomes: 

Problem 2. Let H be a mxn matrix with m < n, and Vi(P ,H,R) : R mx " — y ]R be 
defined as V\{P ,H,R) = \\P Q - P H T (HP H T +R)- l HP \\ 2 F , find the optimal mea- 
surement matrix 

H* =argminVi(P ,ff,/?) 

H 

S.t . H G 2$ mxn ■ 



In this case a closed-form solution is not available. Nonetheless, as the model hand 
adopted has usually a low number of DoFs, the optimal choice H* can be computed by 
exhaustion, substituting all possible sub-sets of m vectors of the canonical basis in the 
cost function V\(P ,H,R). In next section, a more general approach to computing the 
optimal matrix will be provided in order to obtain a result also when a model with a 
large number of DoFs is considered. 



3.2.1 Numerical Solution: Gradient Flows on f mx „ 

In this section, we describe an alternative approach to the solution of problem[2]based 
on a gradiental method. Once again, although the enumeration approach can solve the 
problem in practical cases, the numerical solution based on the method here presented 
will be useful in the design of hybrid sensors. 

A numerical solution for problem|2]can be obtained following a method presented 
in |Zavlanos and Pappas, 2008], which consists in defining a function V 2 (P) with P £ 



R" that forces the entries of P to be as positive as possible, thus penalizing negative 
entries of H. In this paper, we extend this function to measurement matrices H £ ]R mx " 
with m < n. Consider a function V2 ■ G m%n -^Ras 

V 2 (H) = 2 -lr[H T {H-(HoH))] , (15) 

where AoB denotes the Hadamard or elementwise product of the matrices A = (ay) 

andB = (bij), i.e. AoB = (ayfcy). The gradient flow of V 2 (H) is given by ([Zavlanos and Pappas, 2008 1) 



H= H [(HoH) T H -H T (HoH)] , (16) 

which minimizes V2(H) converging to a permutation matrix if H(0) £ G m y.n- 

The two gradient flows given by ( fTTj ) and (16) , both defined on the space of or- 
thogonal matrices, tend to respectively minimize their cost functions. By combining 
these two gradient flows we can achieve a solution for Problem[2] An interesting result 
applies to the dynamics of the convex combination of these gradients, which can be 
stated as follows. 

Theorem 1. Let H £ ]R mx " with m < n be the measurement process matrix and as- 
sume that H(0) £ ffmxn- Moreover, suppose that H(t) satisfies the following matrix 
differential equation, 

H = 4(1 -k)W [P%P H T Z(H)] T + 

+ k H[{H o H) t H - H T (H o H)] , (17) 

where k £ [0, 1] is a positive constant and T,(H) — (HP„H T +R)~ l . For sufficiently 
large k, lim f ^ooi/(f) = Hoc exists and approximates a permutation matrix that also 
(locally) minimizes the squared Frobenius norm of the a posteriori covariance matrix, 

\\Pp\\l 



The proof of this theorem is a direct extension of results in | Zavlanos and Pappas, 2008 1, 
and is omitted for brevity. 



As in most numerical optimization algorithms, the non-convex nature of the cost 
function and of the support set implies the need for multi-start approaches. A possible 
technique to help converge towards the global optimum consists in increasing k during 
the search procedure (cf. |Zavlanos and Pappas, 2008 1). 



3.3 Hybrid Sensing Design 

In this section we analyze the sensing device with both continuous and discrete sensors. 
Up to rearranging the sensor numbering, we can write a hybrid measurement matrix 
//,,/ R" 



as 



H c ,d 



H,, 



where H c £ R m r x " defines the m c continuous sensing elements, whereas H d G 
describes the m d single-joint measurements, with m c + m d = m. Neither the closed- 
form solution valid for continuous sensing design, nor the exhaustion method used for 
discrete measurements are applicable in the hybrid case. Therefore, to optimally design 
hybrid pose sensing systems, we will recur to gradient-based iterative optimization 
algorithms. 

We first consider the case that noise is negligible (R 0). By combining the con- 
tinuous and discrete gradient flows, previously defined in (jTTJ and fll6[ l, respectively, 
we obtain 



H c . d =4(1— A:) [l*P Hl d Z(H c4 )] T + 

+ k H d [{H d o H d ) T H d - H T d (H d o H d )] , 

where k € [0, 1] is a positive constant, T.(H c d ) = (H c d P Hj d )~ l , and 



(18) 



H,, 



0, 



m c xn 



h,, 



On the basis of Theorem [T] the gradient flow defined in ([18} converges toward a 
hybrid sensing system (locally) minimizing the squared Frobenius norm of the a pos- 
teriori covariance matrix. Multi-start strategies have to be used to circumvent the 
problem of local minima. 



When noise is not negligible, the gradient search method of (jT8j would tend to pro- 
duce measurement matrices whose continuous parts, H c , are very large in norm. This 
is an obvious consequence of the fact that, for a fixed noise covariance R, larger mea- 
surement matrices H would produce an apparently higher signal-to-noise ratio in ([TJ. 

This problem can be circumvented by constraining the solution in the sub-set ,^f Cj d = 
{H cd : H c Hj = I mc }. A solution for this problem can be obtain by the following gra- 
dient flow 



K d =4(1— k) W c4 [P*P Hl d L(H c4 )] T + 
+ kH d [(H d oH d ) T H d -H T d (H d oH d )} , 



(19) 



where k e [0, 1] is a positive constant, P p = P - P H J C d (H c>d P H* d + Ry l H Cid P , and 
Z(H c4 ) = {H c4 P Hj d +R)-K With the choice 



W c , d 




for the projection matrix, and starting from any initial guess matrix H c d £ J^f c ,d^ the 
gradient flow remains in the sub-set J4? c ,d, an d converges to a (local) minimum for the 
problem. Also in this case, multistart strategies can circumvent the problem of local 
minima. 



In this section we will describe how the information available by measurement pro- 
cess increases with the minimization of the squared Frobenius norm of the a posteriori 
covariance matrix as well as increasing the number of measures, leading to better esti- 
mation performance. 

First, based on the a priori covariance matrix obtained with the a priori data set 
described in section 3 of [Bian chTet al., 2012b| , we will show the optimal distribution 
of sensors on the hand in case of continuous and discrete sensing devices. We will 
also show that, although the number of measures used with the optimal matrix is less 
than the five measures available by matrix H s (cf. IBianchi et al., 2012b[ ), the hand 
posture information achievable with the optimal measurement matrix H d related to a 
discrete sensing device, is greater, i.e. V\ {H*,) < V\ (H s ), leading to a better hand pose 
estimation performance. 

Second, we will compare the hand posture reconstruction obtained by means of 
matrix H s with the one obtained by using the optimal matrix H* d with the same number 
of measures. Additional random normal noise v with standard deviation of 7° on each 
measure is also considered to evaluate the performance in case of noisy measures. 

4.1 Continuous, Discrete and Hybrid Sensing Distribution 

As shown in section [3] in case of continuous sensing design, the optimal choice H* 
of the measurement matrix H E ]R mxn j s represented by the first m principal compo- 
nents (synergies) of the a priori covariance matrix P . Figure [2] shows the hand sensor 
distribution related to each synergy. 

In case of discrete sensing, the optimal measurement matrix ff?, related to a discrete 
sensing device, for a number of noise-free measures m ranging from 1 to 14, is reported 
in table [T] Notice that, H d does not have an incremental behaviour, especially in case 
of few measures. In other words, the set of DoFs which have to be chosen in case of m 
measures does not necessarily contain all the set of DoFs chosen for m — 1 measures. 
Moreover, noise randomness can slightly change which DoFs have to be measured 
compared with the noise-free case. 

Figure [4] shows the values of the square Frobenius norm of the a posteriori covari- 
ance matrix for increasing number m of noise-free measures. The best performance 
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Legend (cf. figure 2) 
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Figure 2: Optimal continuous sensing distribution for the first PCs of P a . The greater 
is the absolute coefficient w, of the joint angle in the PC, the darker is the color of that 
joint. We assume the coefficient of the i-th joint in the PC to be normalized w.r.t. the 
maximum absolute value of the coefficients that can be achieved all over the joints. 
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Table 1 : Optimal measured DoFs for H* t with increasing number of noise-free mea- 
sures m (cf. figure [3]). 



is obtained by the continuous sensing design, as aspected. Indeed, principal compo- 
nents are considered the optimal measures for the representation of points in the best 
fitting lower dimensional subspace [ Rao, 1964 ], The hybrid performance is better than 
the discrete one, thus representing a trade-off between the quality of estimation of the 
continuous sensing design and feasibility and costs of the discrete one. Moreover, V\ 
values decrease with the number of measures, tending to be zero (cf. figure [4]). This 
fact is trivial because increasing the measurements, the uncertainty on the measured 




variables is reduced. When all the measured information is available V\ assumes zero 
value with perfectly accurate measures. In case of noisy measures, V\ values decrease 
with the number of measures tending to a value which is larger, depending on the level 
of noise. 

For noise-free measures, if we analyze how much V\ reduces with the number 
of measurements w.r.t. the value it assumes for one measure, reduction percentage 
with three measured DoFs is greater than 80%. This result suggests that with only 
three measurements, the optimal matrix can furnish more than 80% of uncertainty 
reduction. This is equivalent to say that a reduced number of measurements is suf- 
ficient to guarantee a good hand posture estimation. In [San tello et al., 1998] and 
IGabiccini and Bicch i, 2010| , under the controllability point of view, authors state that 
three postural synergies are crucial in grasp pre-shaping as well as in grasping force op- 
timization since they take into account for more than 80% of variance in grasp poses. 
Here, the same result can be obtained in terms of measurement process, i.e. from the 
observability point of view: a reduced number of measures coinciding with the first 
three principal components enable for more than 80% reduction of the squared Frobe- 
nius norm of the a posteriori covariance matrix. 

The above reported result seems logic considering the duality between observabil- 
ity and controllability. Moreover, under an engineering point of view, it is reasonable 
that those actuators which are used the most being also the most monitored and hence 
the most sensor endowed. 




Figure 4: Squared Frobenius norm of the a posteriori matrix with noise-free measures 
in case of H*, B* d and H* d (m c = 1). 



5 Discussion 

In this section, we will compare the hand posture reconstruction obtained by applying 
the hand pose reconstruction techniques described in |Bia nchi et al., 2012b | to m = 5 
measures provided by matrix H s and by optimal matrix H* d . 

5.1 Estimation Results with Optimal Discrete Sensing Devices 

Measures are provided by grasp data acquired with the optical tracking system as 
in [Bi anchi etal., 20 12b |, where degrees of freedom to be measured are chosen on 
the basis of optimization procedure outcomes, while the entire pose is recorded to 
produce accurate reference posture. In figure [5] sensor locations related to matrix H s 
and Hj are represented. In order to compare reconstruction performance achieved 
with H s and H* d we use as evaluation indices the average pose estimation error and 
average estimation error for each estimated DoF. Maximum errors are also reported. 
These errors as well as statistical tools are chosen according to the ones considered 
in [Bianchi et al., 2012b| , where it is possible to find a complete description of the here 
adopted. Both noise-free and noisy measures are analyzed. 
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Measured joints: TA, MM, RP, LA and LM 



Figure 5: Discrete sensing distributions for matrix H s , on the left, and H d , on the right 
(cf. figure [3]). The measured joints are highlighted in color. 



5.1.1 Noise-Free Measures 

In terms of average absolute estimation pose errors ([°]), performance obtained with 
H* d is always better than the one exhibited by H s (3.67±0.93 vs. 6.69±2.38). More- 
over, H d exhibits smaller maximum error than the one achieved with H s (i.e. 8.25° 
for H d vs. 13.18° for H s ). Statistical differences between results from H s and H d are 
found (p ~ 0, T neq ). In table [2] average absolute estimation errors with their cor- 
responding standard deviations for each DoF are reported. For the estimated DoFs, 
performance with H*, is always better or not statistically different from the one referred 
to H s , Maximum estimation errors underline cases where H s furnishes smaller values 
and vice versa, since they strictly depend on peculiar poses; however, results from the 
two matrices are globally comparable. 

In figure [7] squared Frobenius norm for the a posteriori covariance matrix of H s 
with m = 5 measures, and H* d with m = 2,3,4,5 measures, in case of noise-free mea- 
sures is reported. Notice that squared Frobenius norm is significantly smaller in the 
optimal case, even when a reduced number of measures is considered. 



5.1.2 Noisy Measures 

In case of noise, performance in terms of average absolute estimation pose errors ([°]) 
obtained with H* d is better than the one exhibited by H s (5.96±1.42 vs. 8.18±2.70). 
Moreover, maximum pose error with H d is the smallest (9.30° vs. 15.35° observed 
with H s ). Statistical difference between results from H s and H d are found (p=0.001, 

Tneq)' 

In table [3] average absolute estimation error with standard deviations are reported 
for each DoF. For the estimated DoFs, performance with H* d is always better or not 
statistically different from the one referred to H s , Maximum estimation errors with H d 
are usually inferior to the ones obtained with H s , 

Figure [8] shows the squared Frobenius norm for the a posteriori covariance matrix 
of H s with m = 5 measures, and H d with m = 2, 3, 4, 5 measures, in case of noise. Also 
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Figure 6: Hand pose reconstructions MVE algorithm by using matrix H s which allows 
to measure TM, IM, MM, RM and LM and matrix H* d which allows to measure TA, 
MM, RP, LA and LM (cf. figure|3]l. In color the real hand posture whereas in white the 
estimated one. 



in this situation, squared Frobenius norm is significantly smaller in the optimal case, 
even if a reduced number of measures is considered, thus suggesting that an optimal 
design leading to error statistics minimization can be achieved using optimal matrix 
with an inferior number of measured DoFs w.r.t. H s . Notice that in this case, squared 
Frobenius norm values are larger than the corresponding ones obtained in absence of 
noise, as expected. 

Finally, in figure [6] some reconstructed poses with MVE algorithm are reported by 
using both H s and H* d measurement matrix, with and without additional noise. Under a 
qualitative point of view, what is noticeable is that reconstructed poses are not far from 



DoF 


Mean Error [°] 


H s vs. H* d 


Max Error [°] 




H* 
a 


p- values 




H"; 

a 




in 1A4-R 


n 




D 1 .OJ 


n 


1 it 


7 1 AJ-4. 54. 


A 84+4- 75 
y,otx+, / ,j 


ft 7? ft 




Oft 1 3 


TMn 


f| 
\J 






1 3 fi4 


TI 


A B 1 4-3 Afi 

t.O I XJ.UO 


5 33+4 1 ft 






15 15 




] 1.96±5.33 


1 \J. -J -J _l ' . U-J 


n id 


26.35 


26.15 


EMo 





4.02±3.43 


o 





16.01 


IP 


13.26±7.06 


5.42±6.44 





27.46 


43.86 


MMo® 
















MP 


12.35±7.75 


4.90±2.91 


0$ 


29.94 


9.91 


RA 


3, 45 ±2.43 


3.82±2.94 




9.51 


12.68 


RMo 





6.68±3.68 








16.01 


RP® 


13.40±9.65 








39.33 





LA 


1L33±5.87 








24,47 





LMo® 
















LP 


11.94±9.52 


6.27±3.97 


0.0002 


36.58 


16.63 



l< 

p- values 

indicates a DoF measured with H s 
® indicates a DoF measured with H% 

Table 2: Average estimation errors and standard deviation for each DoF [o] for the 
simulated acquisition considering H s and H* d both with five noise free measures. Maxi- 
mum errors are also reported as well as p-values from the evaluation of DoF estimation 
errors between H s and Hi, o indicates T eq test. X indicates T neq test. When no symbol 
appears near the tabulated values, U test is used. Bold value indicates no statistical 
difference between the two methods under analysis at 5% significance level. When 
the difference is significative, values are reported with a 10~ 4 precision, p-values less 
than 10~ 4 are considered equal to zero. Symbol "— " is used for those DoFs which are 
measured by both H s and H* r 



the real ones for both measurement matrices. Moreover, it is not surprising that some 
poses seem to be estimated in a better manner using H s and vice versa, even if from the 
previously described statistical results H* t provides best average performance. Indeed, 
MVE methods are thought to minimize error statistics rather than worst-case sensing 
errors related to peculiar poses |Bicchi and Canepa, 1 994|. 
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Figure 7: Squared Frobenius norm for the a posteriori covariance matrix of H s with 
m = 5 measures, and H with m = 2, 3, 4, 5 measures, in case of noise-free measures. 
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Figure 8: Squared Frobenius norm for the a posteriori covariance matrix of H s with 
m = 5 measures, and H with m = 2, 3, 4, 5 measures, in case of noisy measures. 

6 Conclusions 



In this paper, optimal design of sensing glove has been proposed on the basis of the 
minimization of the a posteriori covariance matrix as it results from the estimation 
procedure described in [Bianc hi et al., 20 12b |. Optimal solution are described for the 
continuous, discrete and hybrid case. 

In the continuous sensing case, optimal measures are individuated by principal 
components of the a priori covariance matrix, thus suggesting the importance of pos- 
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simulated acquisition considering H s and Hi both with five noisy measures. Maximum 
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between H s and H* d . o indicates T eq test. % indicates T neq test. When no symbol appears 
near the tabulated values, U test is used. Bold value indicates no statistical difference 
between the two methods under analysis at 5% significance level. When the difference 
is significative, values are reported with a 10~ 4 precision, p-values less than 10~ 4 are 
considered equal to zero. Symbol "— " is used for those DoFs which are measured by 
both//, and//*. 



tural synergies not only for hand control. 

The reconstruction performance obtained by combining the estimation technique 
proposed in [Bianch i et al., 201 2b | and the optimal design proposed in this paper is sig- 
nificantly improved if compared with non-optimal measure case. Therefore, [Bian chi et al., 2012b| 
and [Bian chTet al., 2012a| provide a complete procedure to enhance the performance 
and for a more effective development of both sensorization systems for robotic hands 
and active touch sensing systems, which can be used in a wide range of applications, 
ranging from virtual reality to tele-robotics and rehabilitation. Moreover, by optimiz- 
ing the number and location of sensors the production costs can be further reduced 



without loss of performance, thus increasing device diffusion. 
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This appendix is devoted to the derivation of the gradient equation given in proposi- 



Proof of Proposition 1 The Frobenius norm of a matrix A e R" x " is given as 
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A Appendix 



tion[T] 




and hence, 



P H T (HP o H T +Ry l HP \\ 2 F = \x(P T p P p ) 



(20) 



where P p = P„ — P„H T (HP () H T + R)~ i HP </ . To find the gradient flow, we need to 
compute 

dtr(P£P P ) f ( d{P T p P P ) \ 

=r = tr — ^ = tr 

dH y dH J 

= tt (^ F >) +tt ( p ^)= 2tt ( p ^)> <2i » 

as<9(XY) = (<9X)Y + X(dY) andtr(A r ) =tr(A). Moreover, from differentiation rules 
of expressions w.r.t. a matrix X, we have dX^ 1 = — X -1 (<9X)X~' and hence, assuming 
£(#) = {HP H T +R)-\ we obtain 
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dH 

= -P [(dH) T Z{H)H-H T (L{H) (dHP r) H T + 
+HP a (dH) T ) L(H)H + L{H)dH)] P . (22) 

Substituting |22) in pTj ) and by using a well note trace property (tr(A +B) = tr(A) + 
tr(B)) we obtain 



dtv(P P 

^g-^ = 2 [-ir(P T p P {dH) T i:{H)HP )+tx{P T p P H T Z{H)dHP H T ^{H)HP ) + 

tr(P p T P H T I.{H)HP (dH) T Z(H)HP )-li(P p T P H T Z(H)dHP )] . 



(23) 

As tr(AB) = tr(BA), we obtain 
d\x(P T P ) 

Y H 1 = 2 [-tx{{dH) T T:{H)HP P T p P )+tr{P H T i:(H)HP P T p P H T AH)dH)+ 
+ li{{dH) T Z{H)HP P T p P H T Z{H)HP )~lr{P PlP H T Z{H)dH)} (24) 



and as tr(A r ) = tr(A) we have 
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whence, 

dtr(P^Pp) 
dH 
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Matrices P p , P and are symmetric, and hence, for this particular case we obtain 



d\x(P T p P p ) 



dH - 4 P-PJI'L /I: , (27) 
withE(H) = (HP ( ,H T +R)- 1 . 



